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ARI  Research  Reports  and  Technical  Reports  ere  intended  for  sponsors  of 
R&D  tasks  i  id  for  other  research  and  military  agencies.  Any  findings  ready 
for  implementation  at  the  time  of  publication  are  presented  in  the  last  part 
of  the  Brief.  Upon  completion  of  a  major  phase  of  the  task,  formal  recom¬ 
mendations  for  official  action  normally  art  conveyed  to  appropriate  military 
agencies  by  briefing  or  Disposition  Form. 


FOREWORD 


The  Human  Factors  Technical  Area  of  the  Army  Research  Institute  (AR1) 
is  concerned  with  future  battlefield  demands  for  increased  ability  to  ac¬ 
quire,  transmit,  process,  disseminate,  and  utilize  information.  The  re¬ 
search  focusej  on  the  interface  problems  and  interactions  within  command 
and  control  centers  and  concerns  such  areas  as  tactical  symbology,  informa¬ 
tion  management,  user-oriented  systems,  staff  operations  and  procedures, 
and  sensor  systems  integration  and  utilization. 

Of  special  interest  is  the  problem  of  human  factors  in  the  presentation 
and  interpretation  of  surveillance  and  target  acquisition  information.  One 
relatively  new  source  of  intelligence  information  is  remote  monitoring  of 
the  battlefield,  using  seismic,  acoustic,  and  magnetic  remotely  monitored 
sensors  (REMS)  .  When  enemy  personnel  or  vehicle  movement  activates  these 
remote  sensors,  a  monitor  display  located  behind  our  lines  indicates  the 
activity.  The  operator  can  derive  from  this  display  not  only  the  enemy's 
presence  but  also  such  information  as  direction  and  speed  of  convoys  and 
personnel,  number  of  vehicles  in  a  convoy,  and  convoy  composition— e.g. , 
armored  versus  wheeled  vehicles. 

This  publication  summarizes  ARI  research  on  REMS-related  human  factors 
problems ,  including  the  direct  operational  applications  of  present  and  fu¬ 
ture  utilization  of  remotely  monitored  sensors.  Major  findings  are  summa¬ 
rized  in  the  body  of  the  report— more  details  and  other  results  are  given 
in  the  appendixes  as  briefs  describing  each  experiment. 

Research  on  remotely  monitored  sensor  systems  was  conducted  both  in- 
house  and  under  contract  with  HRB-Singer,  Inc.,  in  response  to  requirements 
of  Army  Project  2Q163739A793  and  to  special  requirements  of  the  U.S.  Army 
Intelligence  Center  and  School,  Fort  Huachuca,  Ariz.j  Project  AVID  GUARDIAN, 
U.S.  Army,  Europe;  and  the  Remotely  Monitored  Battlefield  Sensor  System 
Project  (REMBASS) ,  Fort  Monmouth,  N.J. 
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BRIEF 


requirement  t 

To  aid  in  the  development  and  utilization  of  remotely  monitored  sensors 
(REMS)  by  investigating  and  developing  appropriate  operator  training,  opera¬ 
tional  aids  and  procedures,  system  design  from  a  human  factors  standpoint, 
and  personnel  requirements. 


Research  Products j 

In  the  training  research,  three  self-administerabl'.e,  on-the-job  or 
school  training  packages  were  developed  and  shown  to  result  in  improved 
operator  performance.  Similarly,  three  operttor  aids  ware  developed  and 
shown  to  significantly  improve  operator  performance.  Research  on  operational 
procedures  determined  preferred  work-rest  cycles,  the  minimum  number  of  sen¬ 
sors  required  for  both  string  and  grid  sensor  employment,  and  the  effects  of 
signal/noise  ratio  on  the  performance  of  operators  using  the  acoustical  re¬ 
mote  sensor.  Research  on  user  requires  ts  in  new  REMS  systems  determined 
the  best  type  of  display  from  several  design  options,  the  number  of  sensors 
that  an  operator  can  handle  in  a  display,  improved  concepts  for  the  acoustic 
sensor  system,  and  operator-based  bandwidth  requirements.  Much  of  this  re¬ 
search  affects  personnel  requirements,  by  reducing  number  of  operators  re¬ 
quired,  enhancing  operator  performance,  and  helping  predict  current  and 
future  needs . 


Utilization : 

Much  of  the  ARI  research  on  REMS-related  human  factors  problems  directly 
applies  to  operational  sensor  utilization.  The  training  materials  and  opera¬ 
tor  aids  have  been  integrated  into  the  U.S,  Army  Intelligence  Center  and 
School,  Fort  Huachuca,  Aria.  Research  results  on  user  requirements  have 
been  incorporated  in  the  design  of  the  Remotely  Monitored  Sensor  System 
(REMBASS) .  These  and  other  products  are  in  use  by  other  agencies  in  the 
Army  and  the  Federal  Government. 
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SUMMARY  OF  ARI  RESEARCH  ON  REMOTELY  MONITORED  SENSORS 


BACKGROUND 

Introduction 

In  September  1966,  the  Secretary  of  Defense  directed  the  armed  forces  to 
develop  an  Infiltration  interdiction  capability  to  assess  vehicle  and  per¬ 
sonnel  flow  in  Southeast  Asia  {Army  Manual  ST  30-20-1,  1971).  The  remotely 
monitored  sensors  (formerly  called  unattended  ground  sensors,  or  UGS)  devel¬ 
oped  in  this  program  provide  the  Army's  battlefield  surveillance  and  target 
acquisition  system  with  another  versatile  capability  of  obtaining  real-time 
information  about  enemy  movement. 

Recent  Army  research  and  development  efforts  to  improve  the  capability 
of  remotely  monitored  sensors  (REMS)  have  been  principally  under  the  aegis 
of  the  Remotely  Monitored  Battlefield  Sensor  System  (REMBASS)  program.  Op¬ 
erational  considerations  on  the  use  of  REMS  in  the  Europeeun  environment  have 
been  extensively  studied  under  NATO's  Avid  Guardian  program.  Human  factors 
research  by  the  Army  Research  Institute  (ARI)  to  improve  operator  related 
performance  aspects  of  REI.S  is  summarized  in  this  report. 


The  REMS  System 

The  different  types  of  REMS  in  the  Army  inventory  are  categorized  ac¬ 
cording  to  the  method  of  remote  sensing:  seismic,  acoustic,  magnetic,  elec¬ 
tromagnetic,  and  infrared.  Upon  detection  of  an  enemy  movement,  the  sensor 
transmits  the  data  to  an  unattended  relay  or  directly  to  the  sensor  monitor¬ 
ing  station.  The  operator  (MOS  17  M20)  interprets  the  data  presented  on  the 
R0  376  event  recorder  (current)  or  the  REMBASS  sensor  monitoring  unit  and 
reports,  at  most,  the  target  type,  speed,  direction,  location,  and  number. 

REMS  may  be  tactically  employed  for  offensive  and  defensive  operations 
by  units  ranging  from  small  independent  patrols  to  full  divisions  for  target 
acquisition,  landing  (drop)  zone  monitoring,  combat  sweeps,  ambush,  monitor¬ 
ing  of  avenues  of  approach,  base  camp  defense,  convoy  security,  and  border 
surveillance.  REMS  can  be  employed  in  a  regularly  spaced  "string"  along 
potential  transportation  routes,  in  a  "grid"  pattern  to  cover  a  large  geo¬ 
graphical  area,  or  in  various  "alerting"  patterns  for  simple  detection  of 
activity  in  an  area  (e.g.,  drop  zone). 


Research  Requirements 

Significant  technical  achievements  have  been  made  in  developing  REMS. 
Initially,  little  effort  was  directed  toward  the  study  of  the  operator  and 
the  operator /equipment  interface.  Experience  in  Vietnam  demonstrated  both 
the  value  and  the  human  factors  problems  of  REMS.  Depending  upon  field  con¬ 
ditions,  human  errors  of  omission  and  commission  were  fairly  substantial. 
Planned  extension  of  a  sensor  system,  developed  for  the  Vietnam  conflict. 
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to  worldwide  applications  could  increase  existing  problems  and  cause  addi¬ 
tional  ones.  In  response  to  general  and  specific  requirements  for  solutions 
from  REMS  systems  users  and  developers,  ARI's  research  program  (summarized 
here)  was  initiated.  Specific  needs  for  research  were  generated  by  Project 
Manager  (PM)  REMBASS,  the  U.S.  Army  Intelligence  Center  and  School  (USAICS) , 
and  Project  Avid  Guardian;  they  were  also  derived  from  problems  identified 
by  the  ARI  research  program. 


Research  Design 

The  general  objectives  of  the  following  research  were  to  better  train, 
assist,  and  manage  REMS  operators  and  to  more  effectively  design  and  employ 
equipment  from  a  human  factors  standpoint,  while  considering  operational 
conditions.  The  underlying  philosophy  of  the  research  was  operational  real¬ 
ism  and  controlled,  objective  measurement  of  pertinent  variables. 

The  operators  participating  in  the  experiments  were  always  school 
trained  and  usually  experienced  in  the  field;  however,  practice  in  the  field 
was  often  limited  because  of  lack  of  equipment.  Equipment  used  by  the  op¬ 
erators  participating  in  the  research  was  always  a  close  simulation  to 
existing  or  proposed  devices ,  at  least  for  the  critical  dimension  of  con¬ 
cern.  Sensor  data  presented  to  the  operators  via  the  above  equipment  were 
accurate  recordings  of  data  collected  in  the  field  under  controlled  condi¬ 
tions,  using  operational  equipment  (except  for  the  closely  simulated  acoustic 
sensor  equipment) .  The  sensors  were  activated  under  operational  procedures 
and  conditions  by  U.S.  Army  vehicles  and  personnel  traveling  in  normal  war¬ 
time  modes.  The  above  (operators,  equipment,  and  sensor  data)  were  combined 
to  represent  actual  wartime  use  of  REMS.  Perfect  representation  was  neither 
achieved — nor  was  it  possible. 

Measurement  of  criterion  variables — detection  rights  and  wrongs,  identi¬ 
fication  rights  and  wrongs,  time,  direction,  speed,  and  numbers-  were  com¬ 
pletely  objective,  based  on  actual  knowledge  of  existing  conditions  (rights, 
wrongs,  time,  direction,  and,  sometimes,  number  of  targets)  or  on  school 
solutions  (speed  and  numbers  of  targets) .  Assessment  of  whether  or  not  true 
differences  existed  between  the  conditions  tested  always  relied  on  accepted, 
statistical  design  and  decision  rules — not  on  someone's  opinion  of  the 
difference . 


Organization  of  the  Summary 

The  research  is  summarized  in  terms  of  training,  operator  aids,  opera¬ 
tional  procedures,  REMS  system  design  (REMBASS),  and  personnel  requirements 
(Figure  1) .  Major  findings  in  each  area  are  summarized  along  with  some  of 
the  more  pertinent  data.  More  detailed  description  of  the  research  is  pro¬ 
vided  in  Appendixes  A  through  I,  which  contain  briefs  of  the  cited  research 
reports  and  additional  data. 

Products  of  the  research  program  have  been  utilized  by  USAICS,  PM 
REMBASS,  and  others.  While  some  of  the  operational  applications  are  valid 
across  a  broad  spectrum  of  situations,  others  pertain  only  to  specific  cir¬ 
cumstances  or  contexts.  Additional  use  of  research  findings  should  be  made 
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Figure  1.  Research  products 


with  caution  when  conditions  differ  substantially  from  those  under  which 
the  research  was  performed.  In  no  case  should  operational  applications  of 
the  results  be  instituted  without  a  detailed  review  of  the  research.  Inter¬ 
action  with  ARI  scientists  is  recommended  to  help  insure  effective,  optimal 
application  of  results . 


TRAINING 


Determination  of  Requirements 


The  first  step  in  the  training  research  program  was  to  determine  train¬ 
ing  requirements  on  the  basis  of  a  review  of  documentation,  interviews  of 
senior  instructors,  and,  most  importantly,  actual  problems  encountered  by 
operators  in  interpreting  REMS  output.  The  data  and  conclusions  from  analyz¬ 
ing  operator  errors  in  using  the  string  and  the  grid  deployment  are  reported 
in  Martinek,  Pilette,  and  Biggs  (1978a)  and  Edwards,  Pilette,  and  Martinek 
(1977),  and  for  the  acoustic  sensor  (the  target  identifier  REMS),  in  Pilette, 
Biggs,  and  Martinek  (1979).  In  each,  actual  operator  reports  were  analyzed 
to  document  and  categorize  the  factors  leading  to  human  errors.  These  analy¬ 
ses  were  the  basis  for  development  of  appropriate  training  material  that  could 
be  used  at  the  school  for  formal  training  or  in  the  field  for  proficiency 
maintenance,  involving  little  (if  any)  instructor  participation.  In  each  ex¬ 
periment,  the  operators  were  pretested,  trained,  and  posttested  to  determine 
the  gain  in  proficiency  attributable  to  the  training  materials. 


String  Employment  Text 


The  6-hcur-long,  self-administerable  training  text  developed  under  this 
research  project  (Pilette,  Biggs,  s  Martinek,  1978a)  resulted  in  signifi¬ 
cantly  improved  operator  performance  (Table  1) .  Performance  improved  as 
follows : 


•  Target  detection,  18%; 

•  Target  identification,  31%; 

•  Speed  estimation,  64%; 

•  Number  of  targets  estimation,  63%;  and 

•  Time  required  for  reporting,  15%  (reduction  in  time  may  be  due  to 
practice) . 

The  gains  in  target  detection  and  identification  generally  were  greatest  in 
the  more  difficult  operational  situations  tested — the  condition  of  high  tar¬ 
get  activity  and  the  use  of  2-sensor  strings.  In  addition,  all  participating 
operators  reported  that  the  training  was  "somewhat"  or  "definitely"  better 
than  conventional  training. 

Secondary  findings  pertain  to  training  and  the  operational  use  of  REMS. 
Contrary  to  experience  in  Vietnam,  the  trained  operators  reported  very  few 
false  alarms.  Moreover,  once  a  target  was  detected,  it  was  identified  cor¬ 
rectly  (vehicle  or  personnel)  about  85%  of  the  time.  (See  Appendix  A  for 
more  detail.) 


Table  1 


Operator  Improvement  Due  to  Training  Text 


Performance 

variable 

Operational 

situation 

No. 

Pretest 

correct 

Posttest 

Percent 

improvement 

Detection  rights 

Low  target 
activity 

4.1 

4.6 

12 

High  target 
activity 

6.3 

7.8 

24 

Identification 
rights  (vehicle 

Low  target 
activity 

3.5 

4.3 

23 

vs.  personnel) 

High  target 
activity 

^  *8 

6.6 

34 

Correct  speed 

estimation 

— 

3.9 

6.4 

64 

Correct  number 

of  targets 

— 

4.0 

6.4 

63 

Time  for  target 
reporting  (in 
minutes) 

— 

5.9 

5.0 

15 

Grid  Employment  Text 

Two  days  of  training  substantially  improved  operator  performance  (Pilette, 
Biggs,  &  Martinek,  1978b) .  Target  detection  completeness  improved  by  38%, 
speed-estimation  accuracy  improved  by  23%,  and  target-direction-estimation 
accuracy  improved  by  20%.  The  initially  low  false-alarm  rate  showed  no  sig¬ 
nificant  change.  After  training,  operators  detected  about  95%  of  the  targets 
during  low  workload  conditions  (5  to  8  targets  per  hour) ,  and  61%  when  the 
worklcad  reached  27  targets  per  hour.  Detailed  existing  and  expected  per¬ 
formance  using  the  grid  deployment  is  given  in  Table  2 .  These  data  indicate 
that  operators  can  provide  highly  useful  intelligence  information  from  REMS 
in  a  grid  pattern.  (See  Appendix  B  for  more  detail.) 


Acoustic  REMo  Training 

Research  on  acoustic  REMS  training  was  initiated  because  only  this  sen¬ 
sor  in  today's  inventory  (which  does  not  include  REMBASS  sensors)  has  been 
shown  to  reliably  differentiate  between  vehicle  types.  A  multiobjective  ex¬ 
periment  (Martinek,  Pilette,  &  Biggs,  1978b)  demonstrated  that  with  about 
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4  hours  of  training,  operator  performance  with  acoustic  censors  improved 
substantially  for  each  of  several  target  identification  levels  required. 
The  training  package  (self-administerable  tape  recordings)  increased  oper¬ 
ator  target  identification  performance  between  20%  and  50%,  depending  on 
the  level  of  target  detail  required  (Table  3) .  An  additional  increase  of 
about  13%  can  be  achieved  in  the  field  by  using  only  the  top  one-third  of 
operators  selected  on  their  ability  to  interpret  acoustic  signals.  (See 
Appendix  C  for  more  detail.) 


Table  2 

Detection  Performance  Expectations  Using  Grids 


Workload 

Existing3 

operator 

Operator  with  13  additional 
hours  of  training 

5  tgts/hr 

81%  (4.0  tgts) 

97%  (4.8  tgts) 

8  tgts/hr 

88%  (7.0  tgts) 

94%  (7.5  tgts) 

15  tgts/hr 

28%  (4.2  tgts) 

66%  (10.0  tgts) 

27  tgts/hr 

34%  (9.2  tgts) 

61%  (16.5  tgts) 

a 


School-trained  and  with  some  basic  introduction  to  the  grid  employment. 


OPERATOR  AIDS 

The  error  analyses  that  led  to  the  development  of  the  need  and  problem 
areas  for  the  training  research  also  indicated  that  certain  simple  operator 
aids  would  significantly  enhance  operator  performance.  The  use  of  these  aids 
would  be  taught  at  the  school  (see  preceding  section  on  training)  and  would 
become  part  of  the  operating  procedures  (see  the  following  section) .  How¬ 
ever,  this  section  on  operator  aids  is  different  in  that  it  concerns  devices 
or  techniques  that  a  single  operator  would  use  in  the  field. 


Nomograph/Ruler  Aids 

These  two  simple  devices  are  grouped  together  because  they  would  normally 
be  used  serially  for  the  determination  of  speed  and  number  of  targets.  They 
were  developed  and  validated  (Pilette  et  al.,  1978a)  together  for  the  string 
deployment  of  REMS  and  were  used  successfully  in  several  of  the  research 
projects,  in  the  school  for  training,  and  in  the  field  during  maneuvers. 

Analysis  of  operator  errors  indicated  that  measurement  of  time  on  the 
RQ  376  tactical  recorder  and  subsequent  computations  to  determine  speed  and 
number  of  targets  resulted  in  unreliable  figures.  Use  of  the  devices  in  a 
controlled  experiment  (Pilette  et  al.,  1978a)  resulted  in  the  following  im¬ 
provements  in  operator  performance: 
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A  97%  increase  in  speed  estimation, 

A  7%  increase  in  target  identification  (vehicle  vs.  personnel), 

•  A  67%  increase  in  length  of  convoy  estimation, 

•  A  41%  increase  in  number  of  targets  estimation,  and 

•  A  15%  reduction  in  reporting  time  (probably  due  to  practice) . 

Operator  acceptance  of  the  devices  was  high;  many  devices  disappeared 
after  the  experiment  was  over.  The  calculator  envisioned  for  the  sensor 
monitoring  unit  (SMU)  in  Project  REMBASS  would  obviate  the  need  for  the 
nomograph  except  for  a  manual  backup  and  in  situations  (e.g.,  long-range 
patrols)  not  utilizing  the  SMU.  The  REMS  ruler;  would  continue  to  be  useful 
in  the  new  systems.  (See  Appendix  A  brief  for  more  detail.) 


Grid  Patching  Techniques 

As  the  grid  employment  of  REMS  was  a  post-Vietnam-conflict  concept,  it 
had  not  been  taught  at  school  or  used  in  the  field.  The  operators'  problem 
wit  i  this  method  is  transforming  and  using  the  two-dimensional  space  of  the 
grid  in  the  field  to  the  one -dimensional  representation  of  the  grid  on  the 
display  device  (the  RO  376  tactical  recorder  or  the  REMBASS  SMU) .  Four  tech¬ 
niques  were  developed  and  validated  (Pilette,  Biggs,  Edwards,  &  Martinek, 
1978) .  Although  clear-cut  superiority  for  one  technique  across  all  the 
variables  in  the  experiments  could  not  be  demonstrated,  it  was  concluded  that 
the  row  patching  technique  was  best  with  operators  who  have  received  special 
training,  particularly  when  using  low-density  grids.  The  column  technique 
is  initially  better  (before  training  on  this  concept)  because  of  its  simi¬ 
larity  to  the  patching  technique  used  for  the  string  deployment  of  REMS. 

It  was  concluded  that  the  major  problem  in  employing  sensors  in  a  grid 
is  the  completeness  (not  accuracy)  of  the  operator's  performance  (omissions, 
not  false  alarms) .  Tables  4  and  5  present  more  detailed  data  on  expected 
performance  by  relatively  untrained  and  inexperienced  operators  using  a 
grid  employment.  (See  Appendix  D  brief  for  more  detail.) 


OPERATIONAL  PROCEDURES 

Operational  procedures  are  part  of  the  task  of  the  management  of  the 
REMS  system — how  the  managers  "work"  the  operators  and  "work"  (utilize) 
the  sensors.  For  any  size  REMS  unit  there  is  a  limited  supply  of  resources: 
a  given  number  of  man-hours  and  sensors  are  available  to  cover  a  particular 
area  assigned  to  that  unit.  The  manager  must  optimally  work  and  rest  the 
operators  to  insure  that  fatigue  does  not  reduce  monitoring  performance. 

The  numbers  of  sensor  strings  (and  grids)  monitored  by  one  operator  must 
also  be  controlled,  since  too  great  a  workload  will  reduce  monitoring  per¬ 
formance.  Similarly,  the  number  of  sensors  assigned  to  an  avenue  of  ap¬ 
proach  (in  a  string)  or  to  an  area  (grid)  usually  must  be  kept  to  a  minimum, 
based  on  acceptable  operator  performance  and  the  requirement  to  cover  all 
avenues/areas  with  the  limited  sensor  supply.  Finally,  the  manager  must 
carefully  assess  which  avenues  or  areas  he  can  cover.  The  assessment  is 
based  on  many  factors  that  include  line-of-sight  distance,  especially  when 
using  the  acoustic  sensor,  because  each  relay  used  increases  the  signal/ 
noise  (S/N)  ratio  and  thereby  reduces  operator  identification  performance. 
These  requirements  initiated  the  following  research. 
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Table  4 


Expected  Completeness  Detection  Performance  by  Grid  Density, 
Target  Activity  Level,  and  Patching  Technique 


9-sensor  grid _  _ 24-sensor  grid 


Technique 

Low  target 
activity 
(%) 

High  target 
activity 
(%) 

Low  target 
activity 
(%) 

High  target 
activity 
(%) 

Column 

88 

46 

91 

45 

Perimeter 

90 

34 

84 

36  ' 

Row 

84 

48 

94 

42 

Zone 

85 

39 

94 

42 

Average 

87 

42 

.  91 

41 

Table  5 

Expected  Detection  Accuracy  Performance  by  Grid  Density, 
Target  Activity  Level,  and  Patching  Technique 


9-sensor  grid _  _ 24-sensor  grid 


Technique 

Low  target 

activity 

(%) 

High  target 
activity 
(%) 

Low  target 
activity 
<%> 

High  target 
activity 
(%) 

Column 

96 

96 

79 

84 

Perimeter 

89 

91 

86 

95 

Row 

93 

98 

86 

95 

Zone 

93 

93 

85 

93 

Average 


93 


95 


84 


92 


Work- Re  at  Cycle 


Typical  findings  in  the  research  literature  indicate  that  work  without 
periodic  rest  periods  results  in  performance  decrement.  Similarly,  this 
research  (Martinek  et  al.,  1978a)  demonstrated  that  REMS  operators  given 
rest  periods  every  2  hours  performed  better  than  those  given  only  a  lunch 
break.  The  drop  in  performance  occurs  during  the  second  4-hour  period, 
particularly  in  the  last  2  hours  (Figures  2  and  3) .  This  indicates  that 
an  operator  could  be  kept  monitoring  (during  critical  times)  for  4  to  6 
hours  without  a  drop  in  performance.  No  difference  was  found  between  a 
15-minute  break  and  a  1-hour  break.  (See  Appendix  E  for  more  detail.) 


Number  of  Sensors  Needed 


General .  Past  doctrine  recommended  that  3  to  7  sensors  be  used  in  a 
string  for  avenue-of -approach  surveillance.  Similarly,  it  was  thought  that 
a  grid  with  sensors  spaced  close  together  would  provide  better  information 
to  the  operator.  However,  the  more  sensors  used,  the  greater  the  cost,  the 
more  manpower  required  to  emplace  them,  the  higher  the  detectability,  the 
more  radio-space  required,  and  the  greater  the  number  of  displays  needed.  Two 
experiments  (Martinek  et  al.,  1978a j  Pilette  et  al.,  1979)  investigated  the 
effect  of  string  size  on  REMS  operator  performance,  and  one  (Pilette  et  al., 
1979)  compared  a  9-sensor  grid  to  a  24-sensor  grid  (each  covering  the  same 
area  and  targets) . 

String  Size.  The  results  of  the  two  experiments  comparing  2-sensor, 
3-sensor,  and  4-sensor  strings  are  consistent.  Under  low-target-activity 
conditions,  there  were  no  differences  in  operator  performance  attributable 
to  string  size.  Under  high  target  activity,  the  use  of  3-sensor  and  4- 
sensor  strings  resulted  in  equal  operator  performance,  but  better  than  the 
use  of  2-sensor  strings.  Considering  both  operator  performance  and  cost- 
effectiveness,  and  given  reliable  sensors,  3-sensor  strings  are  preferred. 
However,  a  case  could  be  made  for  2-sensor  strings.  First,  there  were  some 
confounding  experimental  conditions  acting  to  lower  performance  using  2- 
sensor  strings.  In  addition,  assuming  a  shortage  of  sensors  compared  to 
the  number  of  approaches  that  the  commander  needs  covered,  2-sensor  strings 
might  be  required  and  are  as  good  as  the  longer  strings  for  low  target  ac¬ 
tivity.  (See  Appendixes  A  and  E  for  more  details.) 

Sensor  Density  in  a  Grid.  Two  densities  of  sensors  were  compared:  a 
9-sensor  grid  (500  meter  spacing  between  the  seismic  sensors)  and  a  24- 
sensor  grid  (250  meter  spacing  except  for  one  row  which  had  only  4 
sensors) .  In  the  operational  case  the  maximum  spacing  between  sensors 
would  have  to  be  determined  on  the  basis  of  observed  detection  radius  of 
sensors,  gain  settings,  etc.  The  experiment  did  not  test  the  spacing  of 
sensors  but,  rather,  whether  or  not  redundancy  of  sensors  (24-sensor  grid) 
aided  the  operator.  However,  it  was  found  that  the  additional  sensors  (and 
thus  information)  did  not  aid  in  the  detection  of  targets  but  actually  re¬ 
sulted  in  more  false  alarms,  especially  during  low  target  activity  when  the 
operator  had  more  time  to  make  errors,  (See  Appendix  D  for  more  detail.) 
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Figure  2.  Total  correct  detections  for  each  work/rest  cycle. 


Figure  3.  Total  correct  detections  for  work/rest  cycle  pairs. 


The  acoustic  sensor  was  given  special  attention  in  the  research  program 
because  of  its  importance  in  the  identification  of  vehicles  in  a  convoy. 

The  research  {Martinek,  Pilette,  &  Biggs,  1979)  concerned  the  effects  of  S/N 
ratio  on  the  classification  of  vehicles.  The  results  indicated  that  the 
following  rule  of  thumb  can  be  used  when  developing  procedures  for  the  em¬ 
ployment  of  relays  (increasing  noise  level)  and  designing  new  sensors t  a  1% 
decrease  in  operator  performance  occurs  for  every  1.5  dB  loss  in  S/N  ratio. 
(See  Figure  4  for  performance  curves.)  It  was  also  found  that  there  is  a 
tendency  for  operators  under  high  noise  conditions  (such  as  when  using  many 
relays)  to  report  any  vehicle  sounds  as  light-  and  medium-wheeled  vehicles. 
This  implies  that  the  operators  use  relative  sound  intensity  in  discriminating 
between  vehicles  and,  therefore,  use  of  complete  automatic  gain  control  in  a 
new  sensor  is  contraindicated.  (See  Appendix  F  brief  for  more  detail.) 


REMS  SYSTEM  DESIGN 


Requirement 


The  design  of  most  U.S.  Army  hardware  systems  entails  many  decision 
points  and  trade-offs  involving  the  interface  of  equipment  and  the  operator. 
ARI  research  in  this  area  for  REMS  was  done  in  close  coordination  with  the 
Combat  Surveillance  and  Target  Acquisition  Laboratory,  Fort  Monmouth,  N. J. , 
concerning  requirements  for  operator  displays  and  the  acoustic  sensor  for 
Project  REMBASS.  These  often  were  investigated  in  conjunction  with  non¬ 
equipment  requirements  (e.g.,  training)  to  increase  the  cost  effectiveness 
of  the  research.  Similarly,  data  gathered  on  equipment  related  research 
were  used  to  determine  needs  for  research  in  other  areas. 


Sensor  Display  Concepts 


Two  research  efforts  (Martinek,  Hilligoss,  &  Lavicka,  1978;  Edwards, 
Rochford,  &  ShverA,  1977)  compared  the  operational  type  of  display  (RO  376 
Tactical  Data  Recorder)  to  several  variations  of  a  situation  map  display 
proposed  for  possible  inclusion  in  REMBASS.  The  situation  map  display  con¬ 
sists  of  a  map  placed  over  small  lights  that  correspond  to  the  location  of 
the  sensors  in  the  field.  The  light  blinks  rapidly  for  each  activation  of 
its  associated  sensor  and  then  goes  off  until  the  next  activation.  The 
first  experiment  (using  the  string  employment)  compared  use  of  the  RO  376 
display,,  use  of  a  situation  map  display,  and  use  of  time  compression  with 
the  situation  map  display.  With  time  compression,  the  operator  could  re¬ 
view  in  3x  time  any  of  the  past  activations;  in  addition,  he  had  a  forced 
compressed  time  review  (4  minutes  long)  every  30  minutes  of  all  activations 
during  that  time  period.  The  second  experiment  (using  the  grid  employment) 
compared  the  RO  376  to  three  variations  of  the  situation  map  display.  Re¬ 
sults  of  both  experiments  indicated  that  the  operational  type  of  display 
as  represented  by  the  RO  376  was  as  good  as  or  better  than  the  situation 
map  display  and  its  variations  in  terms  of  the  -accuracy  and  completeness 
of  target  detections.  The  RO  376  type  of  display  was  selected  for  the 
Sensor  Monitoring  Unit  of  REMBASS.  (See  Appendixes  G  and  H  for  more 
detail. ) 
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Operator  Workload 


The  number  of  sensors  that  one  operator  can  monitor  without  serious 
deterioration  in  performance  determines,  in  part,  the  requirements  ior  the 
number  of  sensors  that  should  be  shown  on  new  displays  such  as  the  SMU. 

An  investigation  was  carried  out  to  determine  operator  performance  as  a 
function  of  the  workload  (Edwards,  Pilette,  Biggs,  &  Martinek,  1978). 
workload  is  defined  as  the  number  of  targets  an  operator  must  monitor  due 
to  the  combination  of  the  number  of  sensors  and  the  target-activity  level 
for  those  sensors.  Results  indicated  that  operator  performance  decreased 
rapidly  as  a  function  of  workload  (Figure  5) .  Clearly,  an  operator  can 
handle  27  sensors  under  low  target  activity  (85%  detection  completeness) 
and  cannot  handle  very  well  54  sensors  under  high  target  activity  (50%  de¬ 
tection  completeness).  However,  the  above  figures  pertain  to  relatively 
inexperienced  operators  using  REMS  employed  in  a  grid.  It  was  believed 
that,  with  special  training  and/or  using  the  string  employment,  operators 
could  usefully  monitor  60  sensors  under  high  target  activity.  These  data 
provided  a  partial  basis  for  the  initial  SMU  design  displaying  the  output 
of  60  sensors.  (See  Appendix  I  for  more  detail.) 


Acoustic  Sensing  Concepts 

The  operational  U.S.  Army  acoustic  REMS,  designed  for  the  Vietnam  con¬ 
flict,  is  turned  on  automatically  by  seismic  activity,  transmits  for  15 
seconds,  and  is  silent  for  20  seconds.  Use  of  this  type  of  sensor  in  Europe 
would  result  in  a  loss  of  at  least  50%  of  the  information  about  convoys, 
since  a  typical  aggressor  vehicle  column  takes  about  60  seconds  to  pass  a 
sensor.  Two  different  sensing  concepts  were  experimentally  evaluated 
(Martinek  et  al.,  1978b),  using  various  requirements  for  vehicle  detail; 
both  were  judged  to  be  better  than  the  Vietnam  type  of  sensor.  Under  the 
most  stringent  reporting  requirements,  a  small  but  significant  difference 
was  found  in  correct  identifications  for  the  intermittent  concept  (34.4%) 
over  the  continuous  concept  (32.1%).  A  greater  difference  is  expected  for 
actual  operational  conditions  because  of  an  artifact  in  the  experiment 
favoring  the  continuous  concept.  Larger  differences  (not  tested  for  statis¬ 
tical  signif icance)  were  found  for  less  stringent  reporting  requirements. 
(See  Appendix  C  for  more  detail . ) 


Bandwidth 


Two  experiments  (Martinek  et  al.,  1978b;  1979)  investigated  the  ef¬ 
fects  of  acoustical  bandwidth  on  operator  performance  with  the  acoustic 
REMS.  One  indicated  that  a  bandwidth  of  50  to  2,000  hertz  (Hz)  is  better 
than  50  to  1,500  Hz  for  vehicle  identification.  However,  no  difference 
was  found  between  50  to  2,000  Hz  and  50  to  4,000  Hz.  This  result  was 
checked  in  the  second  project  where  50  to  2,000  Hz  was  compared  to  50  to 
4,500  Hz — no  differences  were  found.  Thus,  the  use  of  the  operational 
bandwidth  of  50  to  2,000  Hz  is  sufficient  for  vehicle  identification.  This 
is  not  to  imply  that  a  different  range  (e.g.,  450  to  2,400  Hz)  but  same 
bandwidth  would  be  adequate,  since  the  lower  frequencies  are  probably 
critical  tc  the  identification  of  vehicles.  (See  Appendixes  C  and  F  for 
more  detail.) 
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Figure  5.  Effect  of  workload  on  percent  detections. 
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PERSONNEL  REQUIREMENTS 


The  results  of  this  research  program  indicate  the  complexities  in¬ 
volved  in  forecasting  personnel  requirements.  They  imply  that  the  number 
of  operators  required  depends  on  several  factors,  such  as  target-activity 
level,  number  of  sensors  employed,  type  of  employment,  number  of  displays 
used,  training,  and  fatigue  effects.  Thus  a  first  step  in  forecasting  per¬ 
sonnel  requirements  is  to  determine  the  threat  (number  and  kind)  in  order 
to  determine  the  target-activity  level  expected  in  most  operations.  An¬ 
other  threat  factor  (number  of  approaches  and  area  to  be  covered)  must  be 
considered  to  determine  the  number  of  sensors  to  be  employed  and  the  num¬ 
ber  of  displays  required.  These  data,  combined  with  the  research  findings, 
give  a  first  indication  of  personnel  requirements. 

Another  factor  entering  the  equation  is  related  to  the  research  on 
training  and  work-rest  cycles.  Increased  performance  through  training  re¬ 
duces  the  numbers  of  operators  required.  On  the  other  hand,  the  fatigue 
factor  found  in  the  work-rest  cycle  research  increases  the  personnel 
requirement . 

One  variable  often  ignored  in  forecasting  personnel  requirements  is 
the  commander's  requirement  for  detailed  information.  The  research  on  the 
acoustic  sensor  demonstrated  the  large  reduction  in  identification  accuracy 
due  to  requirements  for  detailed  information.  lowering  the  requirement  for 
detail  increases  the  accuracy  of  information.  Likewise,  part  of  the  improve¬ 
ment  found  in  the  training  research  may  be  attributable  to  the  operators 
ignoring  the  requirements  for  calculating  speed  and  numbers  of  targets. 
Elimination  of  this  requirement  alone  could  account  for  several  minutes  of 
time  per  target.  Target  reports  would  be  more  timely,  and  operator  time 
per  target  reduced,  thereby  reducing  the  number  of  operators  required  for 
a  given  threat. 

Combining  the  threat  factor  with  operator  performance  data  also  can 
identify  some  potential  areas  of  serious  system  breakdown.  Based  on  re¬ 
search  on  the  grid  and  string  employment  of  sensors  (Pilette  et  al.,  1978a, 
1978b;  Edwards  et  al.,  1978),  a  trained  operator  would  detect  about  60  to 
70%  of  the  targets  if  the  activity  level  is  27  targets  per  hour.  Assuming 
that  the  operator's  display  portrays  60  sensors,  and  3-sensor  strings  are 
used,  one  operator  can  cover  20  roads.  Unfortunately,  enemy  columns  (10 
vehicles)  travelirg  at  the  normal  convoy  speed  would  pass  a  sensor  string 
every  3  mirutes,  or  20  columns  per  hour.  In  a  rare  case,  this  means  that 
400  targets  (20  roads  x  20  columns)  could  appear  on  one  display  in  1  hour 
during  a  major  attack.  Even  if  the  enemy  were  to  use  only  5  roads,  100 
columns  per  hour  would  have  to  be  processed  by  the  operator.  Clearly,  more 
operators  or  special  processing  and  reporting  procedures  for  the  operator 
are  required  in  this  critical  overload  situation.  Another  approach  would 
be  to  reassess  the  use  of  a  computer  for  automatic  target  reporting. 

The  above  workload  figures  do  not  necessarily  apply  to  the  new  REMBASS 
acoustic/seismic  identifying  sensor.  This  sensor  provides  more  information, 
but  the  operator's  overload  point  may  be  reached  earlier  because  there  is 
more  information  to  process  and  a  more  complicated  display.  Additional  re¬ 
search  would  be  helpful  to  assess  the  impact  of  new  sensors  and  displays  on 
operator  performance  (and  personnel  requirements)  to  derive  doctrine  for 
all  situations. 


SUMMARY 


This  report  summarizes  ARI  research  on  REMS  in  terms  of  training,  oper¬ 
ator  aids,  operational  procedures,  REMS  system  design,  and  personnel  re¬ 
quirements.  In  the  training  research,  three  on-the-job  or  school  self- 
administerable  training  packages  were  developed,  on  the  basis  of  the  error 
analyses  of  common  operator  problems,  and  validated.  These  training  pack¬ 
ages  resulted  in  demonstrated  improvement  in  operator  performance,  in  both 
the  statistical  and  the  practical  sense.  Similarly,  three  operator  aids 
were  developed  and  shown  to  significantly  improve  operator  performance. 
Research  on  operational  procedures  determined  preferred  work-rest  cycles, 
the  minimum  number  of  sensors  required  for  both  string  and  grid  employment, 
and  the  effects  of  signal/noise  ratio  on  operator  performance  with  the 
acoustical  remote  sensor.  Research  on  user  requirements  in  new  REMS  sys-* 
terns  determined  the  better  type  of  display  from  several  design  options, 
the  number  of  sensors  an  operator  can  handle  on  a  display,  improved  con¬ 
cepts  for  the  acoustic  sensor  system,  and  operator-based  bandwidth  require¬ 
ments.  Many  of  the  above  findings  also  impact  on  personnel  requirements. 
Research  on  REMS  systems  led  not  only  to  improved  operator  performance  but 
also  to  a  reduction  in  the  number  of  operators  required  and  assistance  in 
predicting  current  and  future  personnel  requirements.  A  summary  of  these 
products  and  their  uses  is  shown  in  Figure  6. 
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TRAINING  OPERATOR  AIDS 


Figure  6.  Research  products  and  users 
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APPENDIX  A 


THE  VALUE  OF  SPECIAL  TRAINING  AND  JOB  AIDS  FOR  IMPROVING  UNATTENDED 
GROUND  SENSOR  OPERATOR  PERFORMANCE 

Pilette,  S.,  Biggs,  B.,  &  Martinek,  H.  ARI  Technical  Paper  304,  August 
1978. 


Requirement : 

To  determine  the  value  of  unattended  ground  sensor  operator  train¬ 
ing  and  job  aids  derived  from  an  analysis  of  error  'sources  and  the  ef¬ 
fect  on  operator  performance  of  target  activity  level  and  nunibers  o 
sensors  used  in  a  string. 


Procedure : 

Based  on  an  analysis  of  operator  errors  made  in  a  previous  study, 
a  training  program  and  two  job  aids  were  developed.  To  test  the  value 
of  the  training  and  one  of  the  job  aids  (measuring  device) ,  two  2-hour 
scenarios  were  constructed  for  pre-  and  posttraining  evaluation.  Typi¬ 
cal  target  patterns  at  two  levels  of  target  activity  and  three  levels 
of  sensor  string  size  were  systematically  varied  within  30-nir.ute  seg¬ 
ments.  Authentic  fixed-wing  and  helicopter  activity,  artillery  shell 
bursts,  and  random  noise  were  included  to  simulate  operational,  nontar¬ 
get  activations.  The  second  job  aid,  a  nomograph,  was  evaluated  using 
the  pretest  and  posttest  design.  Two  special  tests  requiring  only  the 
measurement  and  computations  necessary  for  estimates  of  speed  and  enemy 
number (s)  were  developed  for  this  purpose. 

Twenty  school- trained  Amy  enlisted  men  (UGS  (unattended  ground 
sensor)  operators) ,  were  given  test  procedure  training  and  a  short  re¬ 
fresher  in  UGS  interpretation.  Two  10-man  groups  were  formed  and  each 
was  given  different  scenarios  for  the  pretest;  these  were  then  switched 
for  the  posttest.  The  training  program — given  between  the  pretest  and 
posttest — stressed  individualized  instruction  including  self-pacing, 
immediate  feedback,  expert  assistance  when  needed,  and  guaranteed 
student-mastery  using  criterion  testing.  One  job  aid,  an  UGS  ruler 
for  accurately  measuring  the  length  of  activation  patterns,  was  part 
of  the  training  exercise.  The  other  job  aid  (a  nomograph) ,  which  had 
been  developed  to  simplify  arithmetic  calculations  and  decimal  point 
placement,  was  tested  separately  after  the  above  trainina  and  posttest. 


Findings ; 

The  individualized  training  program  resulted  in  significantly  im¬ 
proved  operator  interpretation  performance  in  target  detection  rights. 


identification  rights,  target  speed,  and  target  quantity  estimation. 

Use  of  the  nomograph  significantly  improved  performance  in  identifica¬ 
tion  rights,  target  speed  estimation,  target  quantity  estimation,  and 
reporting  time.  Student  acceptance  of  the  individualized  training  ap¬ 
proach  and  of  both  job  aids  was  high.  Operator  performance  on  3-  and 
4-sensor  strings  was  77%  detection  completeness  with  virtually  no  false 
alarms.  Detection  of  targets  was  better  during  low  target  activity 
than  during  high  target  activity.  Use  of  three  sensors  in  a  string 
resulted  in  the  same  operator  performance  as  use  of  four  sensors. 


Utilization  of  Findings: 

The  lesson  materials  together  with  the  individualized  training  ap¬ 
proach  should  be  used  to  provide  review  and  on-the-job  training  to  oper-' 
ational  field  personnel  and  should  also  be  integrated  into  the  UGS 
course  at  USAICS,  Fort  Huachuca,  Ariz. 

The  nomograph  should  be  included  as  standard  issue  with  opera¬ 
tional  event  recorders  and  should  be  taught  at  UGS  course  USAICS  and 
given  to  each  graduate  to  take  with  him  to  his  assigned  unit.  A  credit- 
card  size  UGS  ruler  should  be  issued  to  everyone  involved  in  monitoring 
UGS  target  activation. 

To  increase  timeliness,  the  UGS  operator  should  send  forward  a 
detection  report  based  on  two  sensors  (or  more,  if  doubt  exists)  with 
a  followup  report  giving  target  type,  speed,  and  number. 

A  research  study  controlling  on  target  difficulty  and  comparing 
2  versus  3  versus  4-sensor  strings  should  be  done  to  provide  data  for 
determining  the  most  efficient  string  size. 

During  high-target-activity  conditions,  operator  reports  should 
be  considered  as  greater  underestimates  than  during  low-target-activity 
periods . 


APPENDIX  B 


THE  VALUE  OF  SPECIAL  TRAINING  FOR  THE  INTERPRETATION  OF  UGS  EMPLOYED 
IN  A  GRID 

Pilette,  S.,  Biggs,  B.,  &  Martinek,  H.  ARI  Technical  Paper  304,  August  1978. 


Requirements : 

1.  To  determine  the  value  of  specialized  training  for  improving 
operator  target  detection  and  direction  and  speed  estimation  perfor¬ 
mance  when  using  unattended  ground  sensors  (UGS)  employed  in  a  grid. 

2.  To  provide  estimates  of  operator  performance  in  an  operational 
situation  for  target  detection  completeness  and  direction  and  speed 
estimation  accuracy  for  UGS  employed  in  a  grid. 


Procedure : 

Based  on  an  error  analysis  of  operator  target  detection  data  from 
previous  research,  a  self-paced  training  program  was  developed  to  reduce 
the  frequency  of  operator  errors.  To  assess  the  value  of  the  training 
program,  a  pre-posttest  design  was  used.  Two  2-hour  scenarios  con¬ 
sisting  of  various  numbars  and  compositions  of  convoys  traveling  cross 
country  were  constructed  from  activation  data  collected  at  a  field  ex¬ 
ercise.  Four  target  workload  conditions  (2.5,  4.0,  7.5,  and  13.5  tar¬ 
gets  per  30-minute  period)  ware  systematically  varied  within  each  2-hour 
scenario.  Each  operator  monitored  all  four  workloads  during  both  the 
pretest  and  posttesc  scenarios. 

Two  groups  of  eight  trained  operators  of  the  Remote  Sensor  Platoon 
of  the  2nd  Armored  Division  at  Fort  Hood  participated  in  3  days  of  train¬ 
ing  and  performance  testing.  Prior  to  the  pretest,  each  group  was  given 
an  orientation  briefing,  an  introduction  to  the  grid  employment  of  UGS, 
row  patching  technique  training,  and  test  procedure  training.  Each 
operator  then  interpreted  one  of  the  two  scenarios  to  determine  his 
baseline  performance  in  target  detection  and  direction  and  speed  esti¬ 
mation  accuracy.  He  next  completed  the  specialized  two-unit  training 
program.  The  first  unit  dealt  with  solitary  targets  (vehicle  or  vehicle 
convoy  traveling  alone  through  the  grid) ,  and  the  second  dealt  with 
target  clusters  (several  targets  in  the  grid  area  at  the  same  time) . 

The  training  program  was  individualized  (self-paced) ,  and  expert  assis¬ 
tance  was  rendered  when  needed.  Student  mastery  was  ascertained  by  the 
monitors  checking  practical  and  criterion  exercise  answers. 
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Operators  used  three  aids  in  the  training  and  in  the  posttest;  they 
used  the  UGS  ruler  and  the  speed  table  to  make  time  measurements  and  to 
facilitate  arithmetic  calculations,  and  used  the  protractor  to  make  more 
precise  target  direction  estimates. 


Findings : 

The  specialized  training  program  with  operator  aids  significantly 
improved  operator  performance  in  target-detection  completeness  and  tar¬ 
get  speed  and  direction  estimation  accuracy.  Target-detection  complete¬ 
ness  improved  by  38%,  while  speed-estimation  accuracy  improved  by  23%. 
The  accuracy  of  target-direction  estimation  improved  by  20%.  The  ini¬ 
tially  low  false-alarm  rate  showed  no  significant  change.  After  train¬ 
ing,  operators  detected  about  95%  of  the  targets  during  low  workload 
conditions  (5-8  targets  per  hour) ,  66%  when  the  workload  was  doubled 
(15  targets  per  hour) ,  and  61%  when  the  workload  reached  27  targets  per 
hour. 


Utilization  of  Findings; 

The  training  materials  and  operator  aids  have  been  integrated  into 
UGS  training  at  U.S.  Army  Intelligence  Center  and  School  (USAICS) ,  Fort 
Huachuca ,  Ariz . 

The  lesson  materials  should  be  given  to  personnel  of  all  remote 
sensor  platoons  periodically  (every  6-12  months)  to  provide  practice 
and  review. 

Intelligence  personnel  should  be  trained  to  properly  assess  oper¬ 
ator's  reports  based  on  the  operator  capability  data  in  this  report,  so 
*c  they  can  effectively  employ  UGS  and  use  the  resulting  intelligence 
ormation . 

The  grid  employment  of  UGS  can  be  used  as  an  early  warning  and 
target  acquisition  system.  The  grid  can  also  provide  approximate  speed 
estimates  for  use  in  a  target  acquisition  system. 

The  atypical  target  paths  used  in  this  experiment  prevent  a  good 
est  .tion  of  the  operator's  ability  to  provide  target  direction  data- 
However,  results  from  the  few  available  "normal"  target  paths  indicate 
that  the  operator  can  give  useful  direction  information  (average  devi¬ 
ation  from  true  direction  was  ±26°).  The  usefulness  of  direction  esti¬ 
mates  should  be  ascertained  using  additional  activation  data  in  a  second 
experiment. 


APPENDIX  C 


VEHICLE  IDENTIFICATION  USING  THE  ACOUSTIC  SENSORt  TRAINING,  SENSING 
CONCEPTS,  AND  BANDWIDTH 

Martinek,  H.,  Pilette,  S.,  &  Biggs,  B.  ARI  Technical  Paper  334,  September 
1978. 


Requirement  : 

The  experiments  were  designed  to  meet  the  following  requirements: 

(a)  to  develop  and  validate  a  training  program  for  using  the  acoustic  sen¬ 
sor  to  identify  vehicles  in  convoy t  (b)  to  provide  estimates  of  operator 
performance  in  identifying  vehicles,  using  the  acoustic  sensor »  and  (c)  to 
investigate  the  effect  of  different  sensing  concepts  and  bandwidth  modifi¬ 
cations  on  the  operator's  ability  to  identify  vehicles. 


Procedure : 

Following  orientation  and  procedure  training,  18  school-trained  op¬ 
erators  of  unattended  ground  sensors  (UGS)  were  tested  on  their  ability  to 
identify  military  vehicles  in  convoys.  Magnetic  tape  recordings  simulating 
use  of  the  acoustic  remote  sensor  in  the  field  were  used.  The  taped  simu¬ 
lation  was  developed  from  recordings  collected  in  the  field  during  maneuvers 
of  armored  and  motorized  infantry  units.  Incorporated  in  the  test  tapes 
in  a  counterbalanced  arrangement  were  two  acoustic  sensing  concepts,  "con¬ 
tinuous"  and  "intermittent."  In  the  continuous  mode,  operators  hear  the 
entire  convoy  as  it  passes  the  microphone.  In  the  intermittent  mode,  they 
hear  each  vehicle  for  a  period  of  only  4  seconds,  with  2  seconds  of  silence 
between  each  vehicle.  Seven  vehicle  types  were  involved-- jeeps,  gamma 
goats,  2*j-ton  trucks,  5-ton  trucks,  10-ton  trucks,  armored  personnel  car¬ 
riers,  and  tanks.  ' 

The  operators  then  received  vehicle  recognition  training  which  used  im¬ 
mediate  feedback,  self-scoring,  paired  comparisons,  and  practice.  After  the 
training,  the  operators  were  retested  to  measure  its  effects.  An  exploratory 
study  was  then  conducted  to  compare  operator  performance  when  different  band- 
widths  were  used--50-1500  cycles  per  second  (cps) ,  50-2000  cps  (now  in  use) , 
and  50-4000  cps. 


Findings : 

The  training  package  developed  increased  operator  vehicle  identifica¬ 
tion  performance  by  44%  to  16%,  depending  on  the  level  of  target  detail 
required. 

An  increase  of  6%  to  10%  in  vehicle  identification  can  be  achieved  by 
using  the  intermittent  type  of  sensor  rather  than  the  continuous.  A  saving 
of  33%  in  battery  life  would  also  result.  Either  type  of  sensor  has  a  greater 
information  potential  than  the  present-day  Audio  Add-On  Unit. 
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An  increase  of  13%  in  vehicle  identification  can  be  achieved  by  using 
the  top  third  of  operators  selected  on  their  ability  to  interpret  acoustic 
signals,  as  measured  by  the  initial  test  in  this  exercise. 

The  50-2000-cps  bandwidth  currently  used  by  the  Army  for  the  remote 
sensor  was  better  than  50-1500  and  as  good  as  50-4000  cps  for  vehicle  iden¬ 
tification  purposes. 


Utilization  of  Findings: 

The  self-administerable  training  tape  should  be  used  at  the  U.S.  Army 
Intelligence  Center  and  School  for  UGS  operator  training  and  in  field  units 
for  periodic  refresher  training. 

Depending  on  field  requirements,  the  remote  sensor  platoon  leader 
should  selectively  assign  operators  on  the  basis  of  their  capabilities. 

Both  the  intermittent  type  and  the  continuous  type  of  sensor  should  La  con¬ 
sidered  for  use  in  the  Remotely  Monitored  Battlefield  Sensor  System  (REMBASS) 

The  bandwidth  currently  used  by  the  Army  for  the  acoustic  remote  sen¬ 
sor  is  adequate. 


APPENDIX  D 


OPTIMUM  PATCHING  TECHNIQUE  FOR  SEISMIC  SENSORS  EMPLOYED  IN  A  GRID 

Pilette,  S.,  Biggs,  B.,  Edwards,  L.  E.,  &  Martinek,  H.  ARI  Technical  Paper 
320,  September  1978. 


Requirement : 

The  requirements  are  to  develop  ways  in  which  seismic  sensors  employed 
in  a  grid  array  can  be  patched  to  an  R0  376  readout  device,  and  to  identify 
the  preferred  technique  for  field  use.  In  addition,  (a)  requirements  are 
to  determine  if  specialized  training  of  unattended  ground  sensor  (UGS) 
operators  is  required  for  interpretation  of  activations  of  seismic  sensors 
enployed  in  a  grid,  <b)  to  find  whether,  or  to  what  extent,  operator  per¬ 
formance  is  affected  by  two  densities  of  sensors  in  a  grid  employment,  and 
(c)  to  determine  the  interactive  effects  of  sensor  density,  target  activity, 
and  patching  techniques  on  operator  performance. 


Procedure  s 

Four  techniques  for  patching  seismic  sensors  employed  in  a  grid  array 
to  the  RO  376  Event  Recorder  were  developed.  Operator  performance  using 
the  techniques  was  compared  under  two  sensor  density  levels— 9  versus  24 
sensors  per  square  kilometer — and  two  levels  of  target  activity— high  and 
low.  The  value  of  training  specific  to  the  use  of  the  patching  techniques 
and  associated  job  aids — target  log,  speed  chart,  and  a  specially  designed 
ruler— was  determined.  Five  2-hour  scenarios  based  on  materials  collected 
in  field  exercises  were  used  in  assessing  operator  performance  in  detecting 
vehicular  targets  under  the  experimental  conditions  described  above.  Fixed- 
and  rotary-wing  aircraft  activity,  artillery  shell  buruts,  and  random  noise 
were  included  in  the  scenarios  to  help  insure  operational  realism.  Twenty- 
four  school-trained  UGS  operators  participated  in  testing  under  the  experi¬ 
mental  conditions.  An  additional  eight  operators  serving  as  a  control  group 
were  not  given  the  special  training. 


Findings : 

Row  patching  was  identified  as  the  preferred  technique!  it  resulted  in 
fewer  false  alarms,  greater  accuracy  in  estimating  target  speed,  and  more 
efficient  use  of  equipment.  It  was  also  preferred  by  more  operators.  The 
patching  technique  training  significantly  enhanced  target  detection  from 
36%  to  51%,  but  did  not  reduce  the  number  of  false  alarms.  Operators  in¬ 
dicated  that,  all  the  job  aids  were  useful,  but  that  the  scale  on  the  ruler 
was  of  value  only  while  they  were  gaining  familiarity  with  the  way  the 
sensors  were  deployed  in  the  grid.  The  percentage  of  targets  detected  under 
the  low-target-activity  condition  was  twice  that  detected  under  the  high- 
target-activity  condition.  Use  of  the  9-sensor  grid  resulted  in  the  same 
detection  performance  and  half  the  number  of  false  alarms  as  use  of  the 
24-sensor  grid. 
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Utilization  of  Findings: 

The  row  patching  technique  is  preferred  for  field  use  with  operators 
trained  in  the  patching  technique.  If  the  operators  have  not  had  such 
training,  and  if  operational  conditions  require  a  higher  detection  rate 
in  spite  of  a  possible  increase  in  false  alarm  rate,  the  column  patching 
technique  is  preferred. 

For  detecting  vehicular  activity,  the  9-sensor  grid  (500-m  spacing  be¬ 
tween  seismic  sensors  or  MINISIDS)  is  preferred  to  the  24-sensor  grid  (250-m 
spacing).  This  preference  exists  in  view  of  the  similarity  of  results, 
and  considering  cost  and  equipment  availability  and  occasional  reduction 
in  the  number  of  false  alarms. 

If  high  target  activity  is  observed,  procedural  changes  should  be  made 
(such  as  assigning  additional  operators  or  increasing  the  number  of  targets 
estimated  by  intelligence  analysts) .  Training  in  the  use  of  the  patching 
technique  and  associated  job  aids  should  be  incorporated  in  the  UGS  school 
content  at  Fort  Huachuca.  Knowledge  of  the  system's  capability  can  be  use¬ 
ful  to  intelligence  officers  in  the  selection  and  utilization  of  field  per¬ 
sonnel  to  enhance  the  reconnaissance  resources  of  the  Army. 

An  error  analysis  should  be  conducted  and  a  training  package  should  be 
developed  and  validated,  to  increase  the  detection  completeness  to  higher 
levels,  reduce  speed  calculation  error,  and  reduce  error  in  determining 
target  direction. 


APPENDIX  E 


THE  EFFECTS  OF  WORK/REST,  TARGET  ACTIVITY,  BACKGROUND  NOISE,  AND  STRING 
SIZE  ON  OPERATOR  INTERPRETATION  OF  UNATTENDED  GROUND  SENSOR  RECORDS 

Martinek,  H.,  Pilette,  S.,  &  Biggs,  B.  ARI  Technical  Paper  300,  June  1978. 


Requirement : 

The  experiment  was  designed  to  (1)  investigate  the  relationships  be* 
tween  unattended  ground  sensor  (UGR)  operator  performance  and  various 
system-dependent  and  target-dependent  parameters  including  work/rest  cycle, 
number  of  sensors  in  a  string,  target  activity  level,  and  background  noise j 
and  (2)  to  identify  sources  of  operator  error  that  can  be  reduced  through 
new  interpretation  techniques,  procedures,  and  training. 


Procedure : 

Two  8- hour  scenarios  were  compiled  from  a  data  bank  of  taped  record¬ 
ings  of  UGS  activations  during  field  tests  by  Modern  Army  Selected  Systems 
Test,  Evaluation,  and  Review  (MASSTER)  at  Fort  Hood,  Tex.  The  tests  were 
run  under  typical  operational  conditions  using  groups  of  personnel  and 
wheeled  and  tracked  vehicles  as  targets.  Roughly  80%  of  the  sensors  were 
seismic,  the  remainder  confirmatory.  All  sensors  were  deployed  in  typical 
string  configurations.  The  scenarios  included  counterbalanced  variations 
of  strings  of  three  different  sizes  (2,  3,  and  4  sensors),  high  and  low 
target  activity,  and  high  and  low  “battle"  noise.  The  high-noise  condition 
contained  the  same  targets  as  the  low  but  also  included  typical  aircraft, 
artillery,  and  high  background  noise  taped  during  the  above  field  tests. 
Four  work/rest  cycles  were  used,  each  of  which  involved  a  total  of  8  hours 
of  work  with  work  and  rest  periods  of  different  durations:  2  hours  work, 

1  hour  rest;  2  hours  work,  15  minutes  rest;  4  hours  work,  1  hour  rest; 
and  4  hours  work,  15  minutes  rest.  Sixteen  students  at  the  U.S.  Army 
Intelligence  Center  and  School  (Ground  Sensor  Department)  at  Fort  Huachuca, 
Ariz. ,  were  given  test  procedure  training  and  a  1-hour  review  consisting 
of  instruction  and  practice  in  interpretation  of  seismic  sensor  records. 
They  were  also  given  a  background  questionnaire  and  a  30-minute  pretest. 
Pretest  results  were  used  as  the  basis  for  assigning  operators  to  the  ex¬ 
perimental  groups.  Each  group  was  assigned  one  of  four  work/rest  cycles 
the  first  test  day  and  a  different  one  the  second  test  day.  Subject 
performance  was  scored  against  the  known  target  activity  for  correct  de¬ 
tections,  wrong  detections,  correct  identifications,  elapsed  time,  and 
confidence . 
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Findings* 


For  8-hour  monitoring  shifts,  2-hour  work  shifts  interspersed  with 
1-hour  or  15-minute  rest  periods  were  better  than  4-hour  work  shifts  inter¬ 
spersed  with  1-hour  or  15-minute  rest  periods.  For  important  short-term 
monitoring  requirements,  operator  performance  was  satisfactory  for  the 
first  4-hour  shift,  but  deteriorated  during  the  second  4-hour  shift. 

Operator  performance  was  equal  using  2-,  3-,  or  4-sensor  strings  in 
the  low-target-activity  condition.  However,  in  the  high-target-activity 
condition,  use  of  3-  or  4-sensor  strings  resulted  in  more  correct  target 
detections  than  use  of  2-sensor  strings. 

Operator  performance  during  the  high  "battlefield"  noise  was  equal 
to  that  during  low  noise. 

During  high- target-activity  conditions,  operators  detected  more 
targets  than  during  low- target- activity  conditions.  They  detected  a 
higher  percentage  of  targets  during  the  low  condition,  however. 

Sources  of  operator  errors  included  the  use  of  2-sensor  strings  for 
the  detection  of  targets  in  a  high-target-activity  condition,  endpoint 
determination,  measurement,  arithmetic  calculations,  and  use  of  confirm¬ 
ing  sensors. 


Utilization  of  Findings: 

The  major  findings  regarding  work/rest  cycles  can  be  used  by  all 
operational  UGS  commands  and  school  units  for  assignment  to  duty  cycles. 
Considering  only  operator  performance  and  assuming  high-sensor  reliability, 
2-sensor  strings,  rather  than  3-  or  4-sensor  strings,  can  be  used  to  re¬ 
duce  costs  if  only  low- target  activity  is  expected.  If  high  activity  is 
expected,  3-sensor  strings  can  be  used  rather  than  4  with  no  operator 
performance  decrement.  .  Operator  problem  areas  identified  should  be  used 
as  the  basis  for  a  new  training  program,  h  UGS  ruler  should  be  developed 
for  measuring  sensor  activation  times  directly  on  the  display;  a  job  aid 
(such  as  a  nomograph)  should  be  developed  to  simplify  arithmetic  computa¬ 
tions  and  decimal  point  placement.  A  programed  text  for  other  operator 
errors  should  be  developed  and  validated. 
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APPENDIX  P 


THE  EFFECT  OF  SIGNAL/NOISE  RATIO  AND  BANDWIDTH  ON  VEHICLE 
IDENTIFICATION,  USING  THE  ACOUSTIC  SENSOR 

Martinek,  H.,  Pilette,  S.,  &  Biggs,  B.  ARI  Technical  Paper  377,  June  1979. 


Requirement : 

To  determine  the  effect  of  variations  of  signal-to-noise  (S/N) 
ratio  on  the  ability  of  remotely  monitored  sensor  (REMS) ,  formerly 
called  unattended  ground  sensor  (UGS) ,  operators  to  identify  vehicles 
in  convoy. 

To  determine  the  effect  of  an  increase  in  bandwidth  on  the  REMS 
operator's  ability  to  identify  vehicles. 


Procedure : 

Three  experiments  were  conducted:  S/N  Ratio,  Individual  Target, 
and  Bandwidth.  In  the  S/N  Ratio  Experiment,  20  operators  received 
special  training,  which  covered  four  levels  (+6  decibels  (dB) ,  +12  dB, 
+18  dB,  and  +24  dB)  of  S/N  ratio.  After  training,  magnetic  tape  re¬ 
cordings  simulating  REMS  outputs  were  used  to  determine  the  operators' 
ability  to  identify  military  vehicles  in  convoys.  Seven  vehicle  types 
were  present  in  the  convoys:  jeeps,  gamma  goats,  2-1/2-ton  trucks, 
5-ton  trucks,  10-ton  trucks,  armored  personnel  carriers,  and  tanks. 

The  test  tapes  were  made  from  recordings  collected  in  field  maneuvers 
of  armored  and  motorized  infantry  units.  A  4  x  4  Graeco-Latin  Square 
design  was  used  to  counterbalance  the  variables  of  S/N  ratios,  opera¬ 
tor  groups,  order  of  presentation,  and  convoys. 

The  Individual  Target  Experiment  presented  operators  with  indi¬ 
vidual  targets  using  only  vehicle  sounds  t.iat  had  similar  signal 
strength  (12  dB  difference) .  The  operators  interpreted  sounds  of 
each  vehicle  type  at  each  of  the  four  S/N  ratios  in  a  randomized 
sequence . 

In  the  Bandwidth  Experiment,  the  operators  were  given  convoy 
sound  recognition  training  using  both  50-2000  hertz  (Hz)  and  50-4500 
Hz  bandwidth s .  They  were  then  tested  on  their  ability  to  identify 
military  vehicles  in  convoys  at  both  bandwidths  using  a  2  x  2  x  4 
modified  Latin  Square  design.  The  variables  of  this  design  are  band¬ 
width,  order  of  presentation,  and  operator  groups. 
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Findings : 


Operator  identification  completeness  tends  to  decline  as  the  S/N 
ratio  decreases  approximately  1%  per  1.5  dB  of  S/N  ratio. 

Operator  identification  completeness  of  light-  and  medium-wheeled 
vehicles  tends  to  increase  as  the  S/N  ratio  decreases.  This  unusual 
relationship  results  from  a  tendency  to  report  (i.e.,  to  guess)  these 
vehicle  types  more  frequently  as  noise  increases.  However,  accuracy 
in  reporting  light-  and  medium-wheeled  vehicles  tends  to  decrease  as 
noise  increases. 

Operator  identification  completeness  of  5-ton  trucks,  10-ton 
trucks,  and  tracked  vehicles  declines  as  the  S/N  ratio  decreases. 

The  50-4500  Hz  bandwidth  provides  no  advantage,  to  identification 
over  the  currenMy  used  50-2000  Hz  bandwidth. 


Utilization  of  Findings  s 

Field  commanders,  training  personnel,  and  operators  should  be 
made  aware  of  the  tendency  of  operators  under  high  noise  conditions 
(such  as  many  relays)  to  identify  any  vehicle  sounds  as  light-  and 
medium-wheeled  vehicles.  Specific  training  to  counteract  this  effect 
should  be  given  both  in  the  school  and  on  the  job. 

From  the  standpoint  of  signal  interpretability ,  there  is  no  re¬ 
quirement  for  new  acoustic  sensors  to  use  a  greater  bandwidth  than 
the  current  one  of  50-2000  Hz. 

For  purposes  of  developing  doctrine  for  the  employment  of  relays 
and  designing  new  acoustic  sensors,  this  rule  of  thumb  can  be  used: 

A  1%  decrease  in  operator  performance  will  occur  for  every  1.5  dB 
loss  in  S/N  ratio. 

Use  of  automatic  gains  control  should  be  limited  to  allow  signal 
loudness  variations  between  vehicle  types. 


APPENDIX  G 


COMPARISON  OF  THREE  DISPLAY  DEVICES  FOR  UNATTENDED  GROUND  SENSORS 

Martinek,  H.,  Hilligoss,  R.  E.,  &  Lavicka,  F.  ARI  Technical  Paper  299, 
August  1978. 


Requirement: 

The  experiment  was  designed  to  determine  the  relative  values  under 
typical  operating  conditions  of  three  methods  of  displaying  activations 
of  seismic  unattended  ground  sensors:  use  of  the  operational  RO  376 
event  recorder,  use  of  a  situation  map  display,  and 'use  of  time  compression 
with  the  situation  map  display. 


Procedure : 

Three  tape  recordings  lasting  2  hours  each  of  the  activations  of 
unattended  ground  sensors  were  compiled  from  the  data  bank  of  recordings 
of  unattended  ground  sensor  activations  taken  during  field  tests  under 
simulated  operational  conditions.  Typical  patterns  at  two  levels  of  tar¬ 
get  activity  were  selected  to  include  both  personnel  and  vehicle  targets. 
To  provide  realistic  simulation,  recorded  activations  of  aircraft,  artil¬ 
lery,  and  background  noise  likely  to  affect  the  interpretation  of  dis¬ 
plays  were  included. 

Twelve  Naval  personnel  trained  and  experienced  in  the  use  of  the 
RO  376  were  given  4  hours  training  in  the  use  of  the  situation  map  dis¬ 
play  and  the  display  used  with  time  compression.  Each  subject  then  in¬ 
terpreted  each  of  the  three  displays  using  a  different  set  of  recorded 
activations  each  time,  in  counterbalanced  order,  and  filled  out  a  stan¬ 
dardized  report  form.  The  reports  were  scored  for  number  of  correct  de¬ 
tections  and  number  of  false  alarms  in  comparison  with  the  known  target 
activity  observed  in  the  Modern  Army  Selected  Systems  Test,  Evaluation, 
and  Review  (MASSTER)  tests  at  Fort  Hood,  Tex. 


Findings : 

Use  of  the  operational  RO  376  resulted  in  higher  accuracy  and 
greater  completeness  of  reports  than  did  use  of  the  other  displays. 

No  differences  were  found  between  the  situation  map  display  and  the 
situation  map  display  used  with  time  compression. 

Target  activity  level,  order  effects,  and  composition  of  the  taped 
activations  affected  operator  performance. 


Utilization  of  Findings: 

The  experiment  reported  here  was  an  early  effort  in  a  series  to 
improve  the  interpretation  of  UGS  activations.  Because  of  its  superior 
ity,  the  RO  376  event  recorder  should  be  used  instead  of  the  situation 
map  display  in  interpreting  activations  of  sensors  deployed  in  strings. 

An  additional  study  that  would  deploy  sensors  using  the  area  in¬ 
trusion  concept  of  sensor  deployment  ("grid"  or  "gated  array")  could 
be  an  additional,  useful  basis  for  evaluation. 

In  view  of  the  effect  on  performance  of  target  activity  level, 
order  effects,  and  composition  of  taped  activations,  these  conditions 
must  be  controlled  in  further  evaluations  of  ground  sensors  in  which 
operators  interpret  and  report  intelligence  information. 


APPENDIX  H 

COMPARISON  OF  FOUR  UNATTENDED  GROUND  SENSOR  DISPLAYS 

Edwards,  L.  E.,  Rochford,  L.  S.,  £  Shvern,  U.  ARI  Technical  Paper  281, 
April  1977. 


Requirement : 

To  compare  under  operational  conditions  four  different  types  of  un¬ 
attended  ground  sensor  (UGS)  displays,  the  RO-376  X-T  plotter  and  three 
variations  of  situation  map  display,  in  terms  of  their  effect  on  monitor 
performance . 


Procedure : 

The  RO-376  X-T  and  the  three  situation  map  displays— a  blinking  light 
to  indicate  an  activation,  a  light  that  increases  in  intensity  with  each 
additional  activation,  and  the  latter  light  plus  the  capability  of  review¬ 
ing  previous  activations  in  compressed  time — were  compared  in  terms  of 
operator  performance.  Four  2 -hour  UGS  scenarios  were  compiled  from  recorded 
field  tests  run  at  Fort  Bragg,  North  Carolina,  using  typical  personnel  and 
vehicle  target  patterns,  noise  sources,  and  two  levels  of  target  activity. 
The  recordings  were  played  back  to  activate  the  displays  during 
experimentation . 

Sixteen  Naval  personnel  (8  relatively  experienced  with  UGS  and  8  in¬ 
experienced)  were  given  training  on  the  displays.  Each  operator  then  moni¬ 
tored  each  display  in  turn  for  2  hours,  reporting  target  information  as  he 
would  operationally,  except  that  prepared  report  forms  were  used.  The  re¬ 
ports  were  compared  to  known  ground  truth  and  were  scored  on  total  detec¬ 
tions,  false  alarms,  detection  accuracy,  and  direction  of  target  movement. 


Findings: 

Operator  performance  was  unaffected  by  type  of  display  used.  Operators 
were  able  to  detect  a  higher  percentage  of  targets  during  periods  of  low 
target  activity  than  during  periods  of  high  target  activity.  However,  ac¬ 
curacy  of  detection  was  greater  during  high  target  activity.  Levels  of  ex¬ 
perience,  time  effects,  and  scenarios  did  not  have  a  significant  effect  on 
performance . 


Utilization  of  Findings : 

The  performance  data  from  this  effort  provide  the  best  available  esti¬ 
mates  of  expected  operator  performance  until  more  extensive  field  data  are 
available.  Typically,  in  the  selection  of  type  of  display  for  a  given  ob¬ 
jective,  operator  performance  with  available  displays  should  be  a  major 
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APPENDIX  I 


THE  EFFECT  OF  WORKLOAD  ON  PERFORMANCE  OF  OPERATORS  MONITORING 
UNATTENDED  GROUND  SENSORS 

Edwards,  L.  E.,  Pilette ,  S.,  Biggs,  B.,  &  Martinek,  H.  ARI  Technical  Paper 
321,  September  1978. 


Requirement : 

To  investigate  the  effect  of  workload  on  operator  performance  as 
defined  by  target  activity  level  and  number  of  unattended  ground  sen¬ 
sors  (UGS)  used. 

To  determine  operators'  target-detection  ability,  false-alarm 
rate,  and  direction  and  speed  estimation  accuracy  to  help  establish 
system  capability. 


Procedure: 

Following  an  orientation  and  training  session,  experienced  UGS 
operators  monitored,  in  sequence,  each  of  three  event  recorder  displays 
showing  activations  of  UGS  used  in  grids.  The  operators  monitored  27 
sensors  (3  grids)  on  one  display,  54  sensors  (6  grids)  on  the  second, 
and  108  sensors  (12  grids)  on  the  third.  Each  grid  was  composed  of 
nine  minisids,  spaced  500  m  apart  to  form  a  1,000  n2  field.  Operators 
encountered  periods  of  high  and  low  target  activity  that  were  of  equal 
time  duration.  Operators  reported  each  target  they  detected  and  esti¬ 
mated  speed  and  direction  of  movement. 


Findings : 

The  number  of  sensors  monitored  and  the  target  activity  level 
significantly  affects  UGS  operator  performance.  The  operators'  ability 
to  detect  targets  decreased  as  either  activity  level  or  number  of  sen¬ 
sors  increased.  Operators'  ability  to  estimate  target  direction  also 
decreased  as  activity  level  increased.  Although  target  speed  was  under¬ 
estimated,  no  significant  differences  were  found  between  any  of  the  ex¬ 
perimental  conditions  for  this  variable,  lhe  false-alarm  rate  was  low 
(one  per  3  hours) . 
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Utilization  of  Findings: 


Careful  judgment  should  be  exercised  in  assigning  workloads  to 
UGS  operators.  Operators  without  special  training  or  experience  should 
not  monitor  more  than  60  sensors,  and  then  only  if  target  activity  is 
low.  If  operators  are  required  to  monitor  more  than  60  sensors  or  if 
target  activity  is  high,  intelligence  estimates  of  target  activity  based 
on  UGS  operator  reports  should  be  adjusted  upward. 

The  grid  deployment  of  UGS  is  a  valid  method  for  surveillance  of 
large  areas  to  detect  vehicular  movement.  Operators'  target-detection 
performance  was  go<-d  even  though  they  had  received  no  training  or  ex¬ 
perience  in  monitoring  UGS  employed  in  grids.  The  false-alarm  rate 
(one  per  3  hours)  and  the  85%  detection  rate  for  the  27-sensor,  low- 
target-activity  condition  demonstrates  the  initial  capability  of  the 
use  of  UGS  employed  in  a  grid.  Although  the  true  speed  of  vehicles 
passing  through  the  grid  was  underestimated  for  all  conditions,  the 
"cross-country"  speed  estimate  (used  for  predicting  time  of  arrival) 
is  as  accurate  as  that  made  for  sensors  deployed  in  the  more  typical 
string  configuration  along  roads  or  trails. 

Special  training  should  be  instituted  for  target  detection  under 
high-workload  conditions  and  for  the  estimation  of  the  target's  direc¬ 
tion  of  travel.  Direction  estimation  was  poor  (±40°  on  the  average); 
but  in  view  of  the  atypical  target  paths  used  in  this  research,  the 
above  value  should  not  be  generalized  to  the  usual  operational 
situation. 


38 


DISTRIBUTION 


1  US  ARMy  CINCPAC  SJPPORT  GROUP  PERSONNEL  DIVISION 
l  HuDA  ATTNt  PMAC 
1  TAG/TAgCEN  ATTNJ  DAAG-EU 

1  HO.  TCaTA  ATTNt  ATCAT-OP-U 

2  HQDA  RESEARCH  AND  STUDIES  OFC 

1  MILITARY  OCCUPATIONAL  DEVELOPMENT  01 V  OAPC-MSP-O,  «M  B52C  HOFFMAN  BLOG  I 
A  OASO  (mHA  AND  L) 

I  HQOA  ATTNt  OAMo-ROR 
I  HQ  TCATA  TECHNICAL  LIbHAHY 

1  HQOA  CHIEF ,  HUMAN  RESOURCES  DEVELOPMENT  DIV 
l  USRAUCO,  STC 
1  HQOA  ATTNt  UAMl-TST 

1  US*  avtATION  SYSTEMS  COMO  ATTNT  DRSAV-ZDR 
1  US4  JORAOCOM  ATTNT  AMSEL-PA-HH 
1  USA  ARRAOCOM  ATTNt  ATFE-LO-AC 

1  HEADQUARTERS.  US  NARINE  CORPS  AlTNt  CODE  MPI-28 

2  US  ARMY  EUROPE  ANO  SEVENTH  ARMY 

1  1ST  INFANTRY  DIVISION  ANO  FT.  RILEY  ATTNt  AAF2N-0PT-T 

1  USA  INTELLIGENCE  AND  SECURITY  COMMANo  ATTNT  lAOPS-TNG 

2  HQ  TRAllOC  TECHNICAL  library 

l  NAVAL  TRAINING  t UJlPMENT  CEN  ATTNt  TECHNICAL  LlbRARY 

l  military  occupational  development  div  attnt  dapc*msp-s,  rm  852C.  hoFfman  blog  i 

1  MILITARY  OCCUPATIONAL  UEVELOPMF.NT  DIV  ATTNT  OAPC-MSP-D.  RM  852C,  mOFFMAN  BLDG  I 

1  MILITARY  OCCUPATIONAL  DEVELOPMENT  DIV  ATTNT  DAPC-MSP-T,  Rm  852C.  HOFFMAN  BLDG  I 

1  USAFACFA  CHIEF.  ORGANIZATIONAL  EFFECTIVENESS  BRANCH 
l  hTh  Infantry  division 
1  HQOA  tank  forces  MANAGEMENT  ofc 
1  NAVAL  air  SYSTEM  COMM'Nu  / 

1  DCSOPS  (DIST  4)  ATTNt  UAMO-RQI  ♦  DAMO-RQC 
I  1230  UsARCOM  RFSERVt  CENTER 
I  FT.  BENJAMIN  HARRISON,  IN  4G2l«> 

1  DIRECTORATE  OF  ARMOR  AVlAllON  ATTNt  ATsb-AAD 
I  AVIATION  DIVISION  ATTNt  ATZK-DPT-Avn  IUM1F5) 

I  USA  FORCES  COMMaNO  AF In  -  OEPUfY  C  OF  S  FOR  INTELLIGENCE 
I  USA  FORCES  COMMAND  AFOP  -  DEPUTY  CHIEF  OF  STAFF  FOR  OPERATIONS 
l  US  ARMY  AIR  defense 

l  DIRECTORATE  of  TRAINING  AlTNt  ATZU-T 
1  DIRECTORATE  OF  COMBAT  UEVtLOPMFNIS  AlTNt  ATZA-D 
1  HQDARCOM  marine  CORPS  LIAISON  OFC 

1  DEPARTMENT  OF  The  ARMY  US  army  INTELLIGENCE  ♦  SECURITY  command 
l  US  army  AGENCY  FOR  AVIATION  SAFtTY  ATTNt  LlbRARlAN,  BLDG  4905 
1  USA  MISSILE  MAT  ERIEL  READINESS  COMMAND  ATTNt  DRSmI-NTN 
l  ARTADS  AlTNt  UWCPM-lOS-Tu 
1  USA  FORCES  COMMANO 
1  PM  TRADE  / 

l  US  MILITARY  DISTRICT  OF  MASHING  I  UN  OFC  OF  EQUAL  OPPORTUNITY 
1  NAVAL  CIVILIAN  PERSONNEL  COMU  SOUTHERN  FLO  DlV 
20  AR1  L 1 A  ISON  OFF  ICE 
1  7 TM  ARmY  TRAINING  CENTER 
I  HQ  USAwtUR  ATTnJ  DCSOPS 
l  HQOA.  OCS  STUUY  OFFICE 
l  USACDEC  ATTNt  ATEC-Ex-E  HuMAN  FACTORS 

l  usafagos/tac  senior  army  advisor 

1  1NTER-UNIV  SEMINAR  ON  ARMtU  FORCtS  «  SOc 
1  USA  ELFCTRONIC  PROVING  grouno  aTTN»  STEEP-MT-S 
1  OASA  (RUA)  DEPUTY  FOR  SCIENCE  AND  TECHNOLOGY 
1  OFC  OF  NAVAL  RESE-RCH  / 

1  AFHRL/lRT 
1  afhrl/i  rl 

I  AIR  FORCE  human  RESOURCtS  LAB  ATTN:  AFHRL/TSR 
I  FEDERAL  AVIATION  ADMINISTRATION  CENTRAL  REGION  library,  ace-66 
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i  657 0  AMRL/BB 
I  6570  AmRL/HE 

1  NAVAL  PERSONNEL  R  AND  0  CtNTtR  COMMAND  AND  SUPPORT  SYSTEMS 
l  NAVY  PfRSONNEL  «  AND  D  CENTER  / 

l  NAVY  PfRSONNEL  R  ANO  D  CENTER  ulRECTOH  OF  PROGRAMS 

1  NAVY  PFRSONNEL  R  ANO  D  CENTER  / 

1  US  ARMY  AVN  ENGINEERING  PLIGHT  ACT  1 V 1 1 Y  ATTNI  savte-td 

i  OFC  Of  naval  research  PERSONNEL  and  training  RESEARCH  PROGRAMS 
1  OFC  OF  naval  research  ASST,  director  pers  ♦  training  rsch  PROGS 

1  OFC  OF  NAVAL  research  project  officer*  environmental  physiology 

I  NAVAL  AEROSPACE  MEDICAL  RSCH  LAD  ATTNI  (CODE  L5l> 
l  BUREAU  OF  naval  PERSONNEL  SCIENTIFIC  advisor  IPErS-OR> 

I  NAVAL  AEROSPACE  MEDICAL  RSCH  LAO  AEROSPACE  PSYCHOLOGY  DEPARTMENT 
1  USA  TRADOC  SYSTEMS  ANALYSIS  ACTIVITY  ATTNI  ATAA-TCA 

i  headuuahters*  coast  guard  chief,  psychological  rsch  rr 

1  USA  RESEARCH  and  TECHNOLOGY  LAH  ATTNI  DAVDL-AS 
l  USA  ENGINEER  TOPOGRAPHIC  LABS  ATTN:  etl-gsl 

1  USA  ENGINEER  TOPOGRAPHIC  LABS  ATTN:  STInFO  CENTER 

1  USA  ENGINEER  TOPOGRAPHIC  LABS  ATTN:  ETl-TD-S 

l  USA  MOrILITY  EQUIPMENT  R  AND  0  COMO  ATTNI  ORDME-TO 

1  NIGHT  VISION  LAH  ATTNI  UHSEL-NV-SOO 

I  USA  TRAINING  BOARD 

I  USA  HUMAN  ENGINEERING  LAb 
1  US  HEL/USAAVNC  / 

i  USA  MATER1FL  SYSTEMS  ANALYSIS  ACTIVITY  ATTNI  DRXSY-M  . 

1  USA  RESEARCH  OFC  / 

1  NAFEC  HUMAN  ENGINEERING  BRANCH 

i  BATTEL!  E-COLUMBUS  LABOMAlUHjtS  IACUCAL  TFCHNICAl  OFc 
1  USA  ARCTIC  TESl  CEN  ATTN:  AMSTt-PL-TS 
1  USA  ARCTIC  TEST  CEN  ATTN:  STEaL-PL-MI 
1  USA  CONCEPTS  ANALYSIS  AGCY  ATTnS  MOC*-W< 

I  USA  CONCEPTS  ANALYSIS  AgCY  ATTNI  MOCA-jf 
1  HQ  WRA(R  UIV  UF  NtUMOPSYLHlATpY 
I  USACACriA  ATTNI  AT/LCA-CI-C 
1  USACACUA  ATTNI  ATZLCA-CI-M 
1  USACACriA  ATTNI  ATZLCA-CI-** 

1  USACACOA  A i IN  I  ATZLCA-CA 

I  USA  ELFCTRONIC  WARFARE  LAb  CHltP,  IN  I tLl  IGENCE  MaTEH  DEVtL  ♦  SUPP  OFF 
i  USA  RSc.H  OEVEL  ♦  SlANDAWUiZA  GP »  U,K, 

1  AFFUL/FGR  (COIL) 

I  USA  NATICK  RESEARCH  AND  UcVELOPMtNT  COMMaNO  CHltF,  BFHAV  SCIENCES  Uiv,  FOOD  SCI  LaB 
1  OASD*  F  and  E  IF  and  LS)  MILI1AHY  asst  for  TNG  ♦  PERS  TEChNOL 
1  TRAJANa  ATTN:  SAJS-OR 
I  HQ  >A  / 

1  NAVAL  AIR  SYSTtMS  COMMANO  ATTNI  AIH-S313 
l  ECOM  ATTN:  AMSEL-CT-0 
1  USACOECEC  TECHNICAL  LIBRARY 
I  USAARL  LIBRARY 

1  HUMAN  WtSOORCES  RSCH  OHG  (HUMRPU)  LIBRARY 
l  SEVILLE  RESEARCH  CORPORA! 1UN 

I  USA  THAUOC  SYSTEMS  ANALYSIS  ACTIVITY  ATTNI  ATAA-SL  (TFCH  LIBRARY) 

I  UNtFORMEU  SEHVICES  UNIT  OF  THE  HEALTH  SCI  DEPARTMENT  OF  PSYCHIATRY 
1  USA  COMPUTER  SYSTEMS  COMMAND  aTTN:  COMMAND  TECHNICAL  l  IBRaHY 
I  HUMAN  PESOURCES  RSCH  OHG  (HUMRRO) 

1  HUMRRO  WESTERN  LIBRARY 

I  EUST1S  UIRECTORaTE,  USAaMRUL  Tt-LHNICAL  LIHRARY 
I  HAND  CoRPOPATION  / 

l  rAnio  Corporation  attni  library  u 

I  FEoERAi  AVIATION  ADMINISTRATION  ATTM  C AMI  library  Acc-AADl 
1  NAFEC  I  IbHARY,  ANA-6A 

I  GRHNINgER  LIBRARY  ATTN:  ATZF-pS-L  BLOG  1313 
I  CENTER  FOH  NAVAL  ANALYSIS 
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I  NAVAL  HEALTH  RScH  CEN  LIBRARY 
1  NAVAL  ELECTRONICS  LAB  ATTN)  RESEARCH  HrrARY 
1  naval  PERSONNEL  h  ANU  0  CEN  LIBRARY  AlTNt  COUE  V201L 
1  AIR  FORCE  HUMAN  RESOURCES  LAb  ATTN;  AFHHL/OT 
1  HQ,  FT.  HUACHuLa  A  f TNl  TECH  R£F'  Uiv 

1  USA  ACADEMY  OF  HEALTH  SCIENCES  STIMSON  LIBRARY  (DOCUMENTS) 
i  SCHOOL  OF  SYSTEMS  ANU  LOGISTICS  ATTN)  AF1T/LSCM 
I  USAMEROC  TECHNICAL  library 

l  OEPARTmENT  of  IhE  NAVY  TRAINING  ANALTSIS  and  EVALUATION  gp 
l  NATIONAL  CENTER  FOH  HEALTH  STATISTICS  / 

1  USMA  OEPT  OF  BEHAVIORAL  SCI  ANU  LEADERSHIP 
i  us  navy  cnet  Support  research  library 

1  OLO  DOMINION  UNIVERSITY  PERFORMANCE  ASSESSMENT  LABORATORY 
1  USA  COMMAND  AND  GENERAL  STAFF  COLLEGE  ATTN)  LIBRARY 
1  USA  TRANSPORT Al ION  SCHOOL  USA  IRANSP  TECH  INFO  AND  RSCH  CFN 
1  NASA  HO  / 

1  NMHOC  PROGRAM  MANAGER  FOR  HUMAN  PERFORMANCE 
1  NAVAL  mEOICAL  R  AND  U  COMMAND  <*♦*) 

i  usa  aomincen  technical  research  bhanch  library 

i.  HQDA  USA  MED  RSCH  AND  UEVEL  COMMAND 
1  USA  FlFLD  arty  HO  / 

1  NAT  CLEARINGHOUSE  FOR  MENTAL  HEALTH  INFo  PARKLARN  BLDG 
1  U  OF  TEXAS  CEN  FDR  COMMUNICATION  RSCH 
1  INSTITUTE  FOR  DEFENSE  ANALYSES 

l  usa  training  support  cenTeh  ucvel  systems  tng  ♦  devicfs  oirectorate 

1  AFHRL  TECHNOLOGY  OFC  <H) 

1  PURDUE  UNlv  UEpT  OF  PSYCHOLOGICAL  SCIENCES 
l  USA  MUhILITY  EUnlPMENT  R  ANU  0  COMMAND  ATTN)  ORUmE-ZG 
I  HQ.  USA  K'JW  ATTN!  ANPE-UE 

1  DA  US  ARMY  RETRAINING  bUE  RESEARCH  ♦  EVALUATION  DIR 

i  usaF  School  of  aerospace  meoicine  aeromedical  library  <tsk*a> 

1  US  MILITARY  ACADEMY  LlbRARY 

I  USa  INTELLIGENCE  Ctu  ANU  SCH  aTTN)  school  LIBRARY 
I  USA  INTELLIGENCE  CEN  AND  SCH  UEPT  OF  GROUND  SENSORS 
l  MARINE  CORPS  INSTITUTE 
1  NAVAL  SAFETY  CtNlER  / 

I  USAAVNC  and  FT*  RjCKtR  AlTNJ  aUU-ES 
1  US  ARMY  AVN  tng  LIBRARY  ATTN;  CHIEF  L lbRARl AN 
1  USAAVNC  ATTNS  AIZU-U 

I  US  MILITARY  ACAoLMY  OFC  OF  Mil  ITARY  LEADERSHIP 
1  US  MILITARY  academy  OlHtCTOP  ()F  INSTITUTIONAL  RSCH 
i  usa  air  defense  school  attn;  aTsa-cd-ms 

I  USaAOS-LIBRARY-dOCUMKNTS 

I  USA  Alp  UEFENSt  HOARD  AlIN}  FILtS  REPOSITORY 
1  USA  INFANTRY  BOaRO  ATIn;  ateb-ib-ts-h 
1  USA  INTELLIGENCE  CEN  \NU  SCH  EDUCATIONAL  ADVISOR 
I  USA  ORDNANCE  CEN  AND  ,'jCH  ATTN;  A1SL-IEM-C 
1  USA  ARmOR  SCHOOL  ATTn;  AlSb-UT-IP 

1  USA  ARmOR  center  DIRECTORATE  OF  COMBAT  DEVELOPMENTS 
I  NAVAL  POSTGRADUATE  SCH  AlIN)  DOOLEY  ANOX  LIBRARY  (COOF  IAp4) 

1  USA  TRANSPORTATION  SCHOOL  OtPuIT  ASSl.  COMMANOANT  EOllCA.  TtCHNOLOii Y 
1  USA  SIGNAL  SCHOOL  ANU  FT,  GORDON  ATT  M)  ATZH-tT 
1  nSA  ARmOR  SCHOOL  eval  branch,  DIRECTORATE  of  instruction 
i  chief  0F  naval  eojcation  and  tng  / 

1  USASlOs  STAFF  and  FACoLIY  otv  AND  ING  DlV 
1  HQ  AtC/XPTo  TRAINING  SrSttMS  DtVELOPMENT 
1  USAISO  ATTNT  Atsit-UT-E 

i  us  army  armor  school  oirectoraIe  of  training 

1  USA  QUARTERMASTER  SCHOOL  DIRECTORATE  OF  TRAINING  DEVELOPMENTS 
1  US  COAST  GLAPO  academy  AlIN;  CADET  COUNSELOR  (DiCK  SLIMAA) 

I  USA  TRANSPORTATION  SCHOOL  OlRFLTOR  OF  TRAINING 
I  USA  INFANTRY  SCHOOL  LIBRARY  / 
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1  US*  INFANTRY  SChODL  ATTNI  AlSH-l-V 
1  US  ARMY  INFANTHY  SCHOOL  ATTNi  aTSH-cO 
1  USA  INFANTRY  SCHOOL  A11NI  ATSH-UOI 
1  USA  INFANTRY  SCHOOL  ATTNt  AlSH-tV 

1  USA  Mil  lTAIJY  POLICE  SChOOL/TRaTNING  C&NTF  R  ATTN*  AWn-PTS 

1  USu  Ml)  ITARY  POLlCb  SCHOOL/ THA THING  CENTER  I)1R»  COMBAT  DEVELOPMENT 

1  USa  Mil  ITARY  POLICE  SCHOOL/ TRAINING  CEMFR  UlR.  TRAININO  DEVELOPMENT 

1  USa  Mil  ITARY  POLICE  SCHOOL/THAINING  CtNTFR  ATTNI  AUn-ACE 

1  US,  INSTITUTE  Of  ADMINISTRATION  ATTNI  RESIDENT  Training  MANAGEMENT 
1  USA  HFLO  ARTILLtRY  SCHOOL  MORRIS  SwtlT  LIBRARY 
1  USA  INSTITUTE  Of  ADMINISTRATION  ACADEMIC  LIBRARY 
I  USA  oAn  COLLtGt  aTTNi  LIBRARY 

1  USA  ENGINEER  SCHOOL  LlHKMRY  AnU  LEARNING  RESOURCES  CENTER 
1  USA  ARMOR  SCHOOL  (USARMS)  ATTnT  LIBRARY 

1  ORGANIZATIONAL  EFFECTIVENESS  TNG  CEN  ♦  SCH  ATTNt  LIBRARIAN 
1  US  ARMy  INTELLIGENCE  CtNTtH  ♦  SCHOOL  ATTNt  ATSl-TO 

1  US  ARMY  INTELLIGENCE  CENttH  ♦  SCHOOL  ATTNt  ATSI-RM-M 

I  US  ARMy  INTELLIGENCE  CENltR  ♦  SCHOOL  ATTNt  ATSl-TO-LO 

I  US  ARMY  INTELLIGENCE  CtNTtH  ♦  SCHOOL  ATTNt  ATSI-CO-CS-C 

1  US  ARMY  INTELLIGENCE  CENltR  ♦  SCHOOL  ATTNt  ATSI-DT-SF-IM 

4  HRITISh  EMBASSY  WHITISH  UtFE.Nct  STAFF 

2  CANADIAN  JOINT  STAFF 
1  CULS  « M )  LIBRARY 

1  FRENCH  MILITARY  ATTACHE 

i  Austrian  Embassy  military  anu  air  attache 

i  CANADIAN  DEFENCf  LIAISON  STAFF  AllN:  COUNSELLOR*  DEFENCE  R  AND  D 
t  ROYAL  nETHFRLANuS  EMBASSY  MlLHARY  AMachE 

1  canaoiai*  forces  base  cuhnwallis  attn:  personnel  selection 

2  CANADIAN  FORCE**  PERSONNEL  APPL  RSCH  UNIT 
1  AH 4Y  PfRSONNEL  RtSEAHCH  ESTABLISHMENT 

1  AR  1Y  PFRSONNEL  HtSKARCH  tSI ABL I SHMtNI  API  SCIENTIFIC  COORDINATION  OFFICE 
l  NETHERLANDS  EMBASSY  OFFlCt  Of  I  HE  AIR  ATTACHE 
b  LIBRARY  UF  CONbRtSS  EXCHANGE  anu  GIFT  UIV 
1  OEFENSF  TECHNlLnL  INFORMAIION  CtlN  ATTNt  OTlC-TC 
153  LIRRAHy  OF  CONGRESS  UNIT  UOCUMtNTS  EXPEDITING  PROJECT 
1  EDITOR.  R  AND  U  MAGAZINE  ? V  T  N  t  URCOE-Ln 

i  us  govfrnment  pointing  ufc  lihrary,  public  documents  department 

I  US  GOVERNMENT  POINTING  OFL  LIBRARY  ANU  STATUTORY,  LlH  DlV  (SLL) 

1  THE  ARMY  LIBRARY 
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